Multi-modal Semantic Place Classification Multi-modal Semantic Place Classification
نویسندگان
چکیده
The ability to represent knowledge about space and its position therein is crucial for a mobile robot. To this end, topological and semantic descriptions are gaining popularity for augmenting purely metric space representations. In this paper we present a multi-modal place classification system that allows a mobile robot to identify places and recognize semantic categories in an indoor environment. The system effectively utilizes information from different robotic sensors by fusing multiple visual cues and laser range data. This is achieved using a high-level cue integration scheme based on a Support Vector Machine (SVM) that learns how to optimally combine and weight each cue. Our multi-modal place classification approach can be used to obtain a real-time semantic space labeling system which integrates information over time and space. We perform an extensive experimental evaluation of the method for two different platforms and environments, on a realistic off-line database and in a live experiment on an autonomous robot. The results clearly demonstrate the effecThe International Journal of Robotics Research Vol. 29, No. 2–3, February/March 2010, pp. 298–320 DOI: 10.1177/0278364909356483 c The Author(s), 2010. Reprints and permissions: http://www.sagepub.co.uk/journalsPermissions.nav Figures 1–15, 17, 18 appear in color online: http://ijr.sagepub.com tiveness of our cue integration scheme and its value for robust place classification under varying conditions. KEY WORDS—recognition, sensor fusion, localization, multi-modal place classification, sensor and cue integration, semantic annotation of space
منابع مشابه
Multi-modal Semantic Place Classification
The ability to represent knowledge about space and its position therein is crucial for a mobile robot. To this end, topological and semantic descriptions are gaining popularity for augmenting purely metric space representations. In this paper we present a multi-modal place classification system that allows a mobile robot to identify places and recognize semantic categories in an indoor environm...
متن کاملMulti-modal Multi-label Semantic Indexing of Images Based on Hybrid Ensemble Learning
Automatic image annotation (AIA) refers to the association of words to whole images which is considered as a promising and effective approach to bridge the semantic gap between low-level visual features and high-level semantic concepts. In this paper, we formulate the task of image annotation as a multi-label multi class semantic image classification problem and propose a simple yet effective m...
متن کاملToward Multi-modal Music Emotion Classification
The performance of categorical music emotion classification that divides emotion into classes and uses audio features alone for emotion classification has reached a limit due to the presence of a semantic gap between the object feature level and the human cognitive level of emotion perception. Motivated by the fact that lyrics carry rich semantic information of a song, we propose a multi-modal ...
متن کاملWeakly Supervised Polarimetric Sar Image Classificationwith Multi-modal Markov Aspect Model
In this paper, we present a weakly supervised classification method for a large polarimetric SAR (PolSAR) imagery using multi-modal markov aspect model (MMAM). Given a training set of subimages with the corresponding semantic concepts defined by the user, learning is based on markov aspect model which captures spatial coherence and thematic coherence. Classification experiments on RadarSat-2 Po...
متن کاملHarmonium Models for Semantic Video Representation and Classification
Accurate and efficient video classification demands the fusion of multimodal information and the use of intermediate representations. Combining the two ideas into the same framework, we propose a probabilistic approach for video classification using intermediate semantic representations derived from the multi-modal features. Based on a class of bipartite undirected graphical models named harmon...
متن کامل